File naming for MSL OPGS EDRs and single frame RDRs

EDRs and single frame image RDRs generated by OPGS share the common file naming convention described on this page.

mission specific

msl

Filenames take the pattern consisting of fixed-size fields:

Field inst config spec sclk prodid geom samp site drive seqid who ver . ext
Position 1-2 3 4 5-13 14-16 17 18 19-21 22-25 26-34 35 36 37 38-40

Details of the file name fields are given below.

inst - Instrument

Positions 1-2, 2 alpha characters representing instrument ID, denoting the source MSL science or engineering instrument that acquired the data.

inst Meaning
AP APXS
CC ChemCam generic
CL ChemCam LIBS
CM CheMin
CR ChemCam RMI
DN DAN
FA Front Hazcam Anaglyph (3-banded)
FL Front Hazcam Left
FR Front Hazcam Right
FS Front Hazcam Stereo (2-banded)
HA MAHLI Anaglyph (3-banded)
HG MAHLI Colorglyph (Lr, Rg, Rb)
HS MAHLI Stereo (2-banded)
MA Mastcam Anaglyph (3-banded)
MD MARDI
MG Mastcam Colorglyph (Lr, Rg, Rb)
MH MAHLI
ML Mastcam Left
MR Mastcam Right
MS Mastcam Stereo (2-banded)
NA Navcam Anaglyph (3-banded)
NL Navcam Left
NR Navcam Right
NS Navcam Stereo (2-banded)
RA Front Hazcam Anaglyph (3-banded)
RD RAD
RL Rear Hazcam Left
RM REMS
RR Rear Hazcam Right
RS Rear Hazcam Stereo (2-banded)
SM SAM
SP SA/SPaH

config - Instrument configuration

Position 3 - 1 alphanumeric character representing the instrument configuration, an operational attribute of the Instrument that assists in characterizing the data.

Instrument config Meaning
Front Hazcam, Rear Hazcam, Navcam A, B A-side configuration, B-side configuration
ChemCam LIBS 0 Image data (Fullframe, Subframe, Downsampled, Thumbnail, Reference Pixel, Row-summed, Column-summed, Histogram)
ChemCam RMI 0-9 0 = 1-D Average Spectra, no laser; 1 = 1-D Single Spectra, no laser; 2 = Spectra Stats (Mean & Std Dev), no laser; 3 = 2-D Diagnostic, no laser; 4 = 1-D Average Spectra Laser; 5 = 1-D Single Spectra Laser; 6 = Spectra Stats (Mean & Std Dev), laser capable; 7 = 2-D Diagnostic Laser; 8 = Spectra Stats (all), laser capable; 9 = Spectra Stats (all), no laser
ChemCam Generic 0-5 0 = SOH; 1 = Params; 2 = Memory Dump; 3 = Debug Dump; 4 = Move Focus; 5 = Util Test
Mastcam 0-7 Filters 0 thru 7
R, G, B, F, U, L, D, C, A r = Red Bayer cells only, or Red band of JPEG’d product; G = Green Bayer cells only, or Green band of JPEG’d product; B = Blue Bayer cells only, or Blue band of JPEG’d product; F = Full color de-Bayered RGB merged into single 3-band image; U = Upper half of Green cells only; L = Lower half of Green cells only; D = All Green cells (double resolution in one dimension); C = All cells, corrected for responsivity with the filter; A = All cells, with 2x2 averaging
MAHLI 0 - 3 0 = cover closed, LEDs off; 1 = cover open, LEDs off; 2 = cover closed, LEDs on; 3 = cover open, LEDs on
  R, G, B, F, U, L, D, C, A Same as for Mastcam
MARDI 0 No filters
  R, G, B, F, U, L, D, C, A Same as for Mastcam

spec - Special processing flag

Position 4, 1 character as the special processing flag, applicable to RDRs only. The Special Processing character is used to indicate off-nominal or special processing of the image. Examples include a) use of different correlation parameters, b) special stretches to eliminate shadows, c) reprocessing with different camera pointing, etc.

The meaning of any individual character in this field will be defined on an ad hoc basis as needed during the mission. Within one Sol or a range of Sol’s, the character will be used consistently. So, this field can be used to group together all derived products resulting in one kind of special processing. An attempt will be made to maintain consistency across different Sol's as well, but this may not always be possible; thus the meaning of characters may change across different individual or ranges of Sol's, depending on the definition.

A ".txt" ASCII text file will be maintained containing all special processing designators that are used, the Sol's they relate to, and a description of the special processing that was done. This file will be included in the PDS archive.

Best Tactical - If value is character "T", it indicates "best tactical" if other than nominal processing. The intent of this is to hold a copy of the special product best suited for tactical planning (at the discretion of OPGS ops personnel in consultation with tactical planners). Such products should have an ordinary special processing flag documented as described here, but be copied to flag "T" (incrementing version if necessary) if they are to be used for tactical planning.

If there is no "T", then the nominal "_" should be used for tactical planning.

spec (EDRs) spec (RDRs) Meaning
_ _ None
n/a A - S

Special method types A-S and U-Z

n/a U - Z Best tactical Special method

sclk - Spacecraft clock count

Positions 5-13, 9 alphanumeric characters representing the spacecraft clock count in seconds. Which specific SCLK is used depends on the instrument but is generally expected to be the time the data was acquired. For the engineering cameras and ChemCam, the SCLK in the IDPH is used. For MMM cameras, the SCLK in the MMM mini-header is used. It is not guaranteed that this SCLK match the DVT (Data Validity Time) used for operational data management.

prodid - Product ID

Positions 14-16, 3 characters as a product type identifier. Values beginning with "E" are of type EDR, which is the first order product with no processing applied, such as geometric correction ("linearization") or radiometric correction. Otherwise, the product is an RDR.

Image EDRs
prodid Meaning
EDR First order product
ERP Reference Pixel
ERS Row-summed
ECS Column-summed
EHG Histogram
EIN State-of-Health Initialize (ChemCam SOH only)
EPW State-of-Health Power On (ChemCam SOH only)
EPO State-of-Health Power Off (ChemCam SOH only)
EWU State-of-Health Warmup (ChemCam SOH only)
ESS State-of-Health Sun Safe (ChemCam SOH only)
EJP Original JPEG as received from rover (MMM cameras only)
EZS Z-stack combined image (MMM cameras only)
EDM Depth map image (MMM cameras only)
EVD Video image (MMM cameras only)
ERD Recovered EDR (MMM cameras only)
Image RDRs
prodid Meaning
LIN CAHV-linearized (identical to "EDR" except for Geometry type)
BAY Bayer pattern (identical to "EDR" except for Bayer pattern extract)
ILT Inverse lookup table (ILUT)
ILC Inverse lookup table (ILUT) with corrections such as despike
ILP Inverse lookup table (ILUT) with pointing correction applied
RAD Rad-corrected absolute radiance units, integer
RAS Rad-corrected absolute radiance units, scaled to 12-bit
RAF Rad-corrected absolute radiance units, float
RIE Rad-corrected for Instrument Effects only, integer DN
RIF Rad-corrected for Instrument Effects only, float
IOI Rad-corrected IOF radiance factor, integer
IOF Rad-corrected IOF radiance factor, float
DSP Stereo Disparity Final
DSR Stereo Disparity Raw
DSL Stereo Disparity of Lines (single-band)
DSS Stereo Disparity of Samples (single-band)
DSG Stereo Disparity Grid
DSE Stereo Disparity Error Metric
MDS Stereo Disparity Mask File
DDD Stereo Delta Disparity (2-band, true disparity offset)
DDL Stereo Delta Disparity Line (single-band)
DDS Stereo Delta Disparity Sample (single-band)
DFF Stereo First-stage Disparity Final
DFL Stereo First-stage Disparity Line
DFS Stereo First-stage Disparity Sample
XYZ XYZ expressed in Site frame
XYE XYZ Error Metric
XYR XYZ expressed in Rover Nav frame
XYM XYZ Masked
MXY XYZ Mask File
XYO XYZ with Overlay
XYF XYZ Filled
XXX XYZ X-band
YYY XYZ Y-band
ZZZ XYZ Z-band
XXF XYZ X-band Filled
YYF XYZ Y-band Filled
ZZF XYZ Z-band Filled
UVW Surface Normal (UVW)
UVS Surface Normal (UVW) for Slope computations
UVP Surface Normal (UVW) Projected onto Plane
UVT Surface Normal (UVW) Angle (‘T’ for theta) between Normal and Plane
UVO Surface Normal (UVW) with Overlay
UVF Surface Normal (UVW) Filled
UUU Surface Normal (UVW) U-band
VVV Surface Normal (UVW) V-band
WWW Surface Normal (UVW) W-band
UUF Surface Normal (UVW) U-band Filled
VVF Surface Normal (UVW) V-band Filled
WWF Surface Normal (UVW) W-band Filled
RUD Surface Roughness (Drill)
RUT Surface Roughness (DRT)
RNG Range from Camera
RNR Range from Rover Nav frame origin
RNO Range with Overlay
RNF Range Filled
RNE Range Error Metric
ARM Arm Reachability
ARO Arm Reachability with Overlay
ARK Arm Reachability Masked
MAR Arm Reachability Mask File
ARP Arm Preload Values
SLP Slope
SLO Slope with Overlay
SRD Slope Rover Direction
SRO Slope Rover Direction with Overlay
SHD Slope Heading
SHO Slope Heading with Overlay
SMG Slope Magnitude
SMO Slope Magnitude with Overlay
SNT Slope Northerly Tilt
SNO Slope Northerly Tilt with Overlay
SEN Solar Energy
SEO Solar Energy with Overlay
IEP Incidence, Emission, Phase angles
IEF Incidence, Emission, Phase angles Filled
Spectroscopy (LIBS) RDRs
prodid Meaning
RDR Initial LIBS Spectrum
NSR Nearby Sample of Reference
MEC Multivariate Prediction of Elemental Composition
MOC Multivariate Prediction of Oxide Composition
UEC Univariate Prediction of Elemental Composition
UOC Univariate Prediction of Oxide Composition
RSM Sammon’s Map
CCS Intermediate Clean Calibrated Spectra

geom - Geometry

Position 17, 1 alphanumeric character representing geometry type, used to differentiate products as having camera-induced distortion removed ("linearized") or not removed ("non-linearized").

note

OPGS-produced MMM products are produced to support operations and are not archived. Discussion of MMM product geometry is included to maintain consistency with the SIS.

For MMM camera products, also serves a secondary function by flagging changes in compression mode across iterations of the same data to distinguish between MMM product types.

Products from stereo cameras are normally linearized using the nominal stereo partner (whether the partner image was actually acquired or not). Products such as long-baseline or re-pointed stereo pairs, however, are often linearized using the actual stereo partner, resulting in different geometry.

This field is assigned as follows:

a) Linearization - If value is any alpha character "A - Z", then product is "linearized" using one of the two modes (nominal or actual) according to the table below. If value is not any alpha character, then product is "non-linearized".

b) First Compression Mode - For all cameras, if value is an underscore ("_"), "L" (for "linearized-nominal") or "A" (for "linearized-actual"), it denotes that compression mode is for the first instance of the product data processed on the ground. The identity of the mode type, whether "uncompressed" or a type of compression, is not provided here.

c) Changed Compression Modes - For MMM cameras, if value is an integer "1 - 9, 0" (iterating numerically in order of 1, 2 … 9, 0), or in the character ranges "M - V" (iterating alphabetically after "L" for "linearized-nominal") or "B - K" (iterating alphabetically after "A" for "linearized-actual"), it indicates a different compression mode than all previous modes noted. Again, the identity of the mode type, whether "uncompressed" or a type of compression, is not provided here.

These flags are necessary because operation of MMM cameras includes the possibility that the same image be requested multiple times from the rover, each with different compression modes. In these cases, the compression mode for the first product processed on the ground is noted. Thereafter, if the compression mode for any subsequent product processed on the ground is different than all previous modes, it will be noted and indexed incrementally (using alpha characters for "linearized" and integers for "non-linearized").

Camera type Compression mode Non-linearized Linearized
Nominal Actual
All 1st compression mode received _ L A
MMM only 2nd compression mode, different than any previous mode 1 M B
3rd compression mode, different than any previous mode 2 N C
: : : :
10th compression mode, different than any previous mode 9 U J
11th compression mode or higher, different than any previous mode 0 V K

NOTE

Retransmissions or reprocessing of the same compression mode will reuse the appropriate mode character, with file name’s Version field incrementing for each retransmission.

The EDR controls the compression mode flag. All RDRs derived from a given EDR share the same row in the table above. So, "2" and "N" and "C" will always correspond, for example.

samp - Sample type

Position 18, 1 character representing sample type, indicating how the data were sampled.

samp Meaning
B Bayer extraction subsampling (MMM only) raster data
D Downsampled raster data, reduced resolution
F Full frame raster data, full resolution
M Mixed (Subframe and Downsampled) raster data, mixed resolution
N Non-raster data
S Subframed raster data, full resolution
T Thumbnail raster data, reduced resolution
Y Thumbnail Bayer extraction

site - Site location count

Positions 19-21, 3 alphanumeric characters representing the site location count within the current site, from the Rover Motion Counter.

site Meaning
000, 001, ... 999 0 - 999
A00, A01, ... A99 1000 - 1099
Z00, Z01, ... Z99 3500 - 3599
AA0, AA1, ... AA9 3600 - 3609
AB0, AB1, ... AB9 3610 - 3619
ZZ0, ZZ1, ... ZZ9 10350 - 10359
AAA, AAB, ... AAZ 10360 - 10385
ABA, ABB, ... ABZ 10386 - 10411
0AA, 0AB, ... 0AZ 27936 - 27961
7DA, &DB, ... 7DV 32746 - 32767
_ _ _ (3 consecutive underscores) Out of range

drive - Drive location count

Positions 22-25, 4 alphanumeric characters representing the drive location count within the current site, from the Rover Motion Counter.

drive Meaning
0000, 0001, ... 9999 0 - 9999
A000, A001, ... A999 10000 - 10999
Z000, Z001, ... Z999 35000 - 35999
AA00, AA01, ... AA99 36000 - 36099
AZ00, AZ01, ... AZ99 38500 - 38599
BA00, BA01, ... BA99 36000 - 38699
LJ00, LJ01, ... LJ35 65500 - 65535
_ _ _ _ (4 underscores) Out of range

seqid - Sequence ID

Positions 26-34, 9 alphanumeric characters as a sequence identifier. Composed of a 4-char subfield and a 5-digit numeric subfield representing the 6-bit "Category" and 14-bit numeric components of the commanded Sequence ID, respectively.

who - Producer

Position 35, 1 alpha character representing the data producer.

who Meaning
M MIPL (Multi-mission Image Processing Laboratory), JPL
P Instrument principal investigator
  APXS Max Planck Institute (Germany)
  ChemCam LIBS and SOH LANL (Los Alamos, NM)
  ChemCam RMI IRAP (France)
  CheMin Ames Research Center (Mountain View, CA)
  DAN Federal Space Agency (Russia)
  MARDI, Mastcam, MAHLI MSSS (San Diego, CA)
  RAD SwRI (Boulder, CO)
  REMS Ministry of Education and Science (Spain)
  SAM GSFC (Goddard, Md)
A-L Co-Investigators (to be identified by PI per instrument)

ver - Version

Position 36, 1 alphanumeric character as the version identifier. The Version number increments by one whenever an otherwise-identical filename would be produced. The valid values, in their progression that excludes "0" altogether, are as follows (non-Hex):

ver Meaning
1, 2, ... 9 1-9
A, B, ... Z 10-35
_ 36 and higher

Note

that not every version need exist, e.g. versions 1, 2 and 4 may exist but not 3. In general, the highest-numbered Version represents the "best" version of that product.

This field increments independently of all fields, including the Special Processing field.

ext - Extension

Position 38-40, 2 to 3 alphanumeric characters denoting the product type.

Valid values for nominal operations products:

IMG Image EDRs / RDRs (ODL-format labeled, may include embedded VICAR)
VIC Temporary image EDR / RDRs with only VICAR label (no ODL-format label)
iv Per-wedge Terrain Mesh RDR in Inventor binary format (no label)
ht Per-wedge Height Map RDR (VICAR label)
rgb Per-wedge Terrain Mesh texture RDR in RGB format (no label)
LBL Detached label in PDS or ODL format
JPG JPEG compressed (no label)
TIF TIFF format (no label)
PNG PNG format (no label)
TXT Text file associated with Specially-processed files
tar Tar file containing Per-wedge Terrain Mesh vertice tile files

Valid values for non-image products:

QUB Multi-layer spectral cube data
CSV Comma-separated-value text file, used for LIBS RDRs
DAT Non-imaging instrument data, including LIBS and ChemCam state-of-health
LBL Detached label in PDS or ODL format
TAB Table data

 

see also